Swarming Behavior of Multi- Agent Systems * 
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Abstract: In this paper we consider a continuous-time anisotropic swarm model in n-dimensional 
space with an attraction/repulsion function and study its aggregation properties. It is shown that 
the swarm members will aggregate and eventually form a cohesive cluster of finite size around 
the swarm center. Moreover, the numerical simulations show that all agents will eventually enter 
into and remain in a bounded region around the swarm center. The model is more general than 
isotropic swarms and our results provide further insight into the effect of the interaction pattern 
on individual motion in a swarm system. 
Keywords: Biological systems, multiagent systems, swarms. 



1 Introduction 

In nature swarming can be found in many organ- 
isms ranging from simple bacteria to more ad- 
vanced mammals. Examples of swarms include 
flocks of birds, schools of fish, herds of animals, 
and colonies of bacteria. Such collective behav- 
ior has certain advantages such as avoiding preda- 
tors and increasing the chance of finding food. 
Recently, there has been a growing interest in 
biomimicry of forging and swarming for using 
in engineering applications such as optimization, 
robotics, military applications and autonomous 
air vehicle PP-[7]. Modeling and exploring the col- 
lective dynamics has become an important issue 
and many papers have appeared |H] — • How- 
ever, results on the anisotropic swarms are rela- 
tively few. The study of anisotropic swarm is very 
difficult though the anisotropic swarm is a ubiq- 
uitous phenomenon, including natural phenomena 
and social phenomena. 

Gazi and Passino proposed an isotropic 
swarm model and studied its aggregation, cohe- 
sion and stability properties. Subsequently, Chu 
and Wang generalized their model, consider- 
ing an anisotropic swarm model, and obtained 
the properties of aggregation, cohesion and com- 
pletely stability. The coupling matrix W consid- 
ered in 0j is symmetric, that is, the interactions 
between two individuals are reciprocal. In this 
paper, we try to study the behavior of anisotropic 
swarms when the coupling matrix is completely 
nonsymmctric. The model and the results given 



here extend the work on isotropic swarms and 
anisotropic swarms .4. to more general cases and 
further illustrate the effect of the interaction pat- 
tern on individual motion in swarm system. 

In the next section we specify an "individual- 
based" continuous-time anisotropic swarm model 
in an n-dimensional Euclidean space which in- 
cludes the isotropic model of [2] as a special case. 
Then, under some assumptions, we show that the 
swarm can exhibit aggregation in Section 3. In 
Section 4, we extend the results in Section 3, con- 
sidering a more general attraction/repulsion func- 
tion. In Section 5, under some assumptions, we 
provide some numerical simulations of the agent 
motion. We briefly summarize the results of the 
paper in Section 6. 



2 Anisotropic Swarms 

We consider a swarm of N individuals (members) 
in an n-dimensional Euclidean space. We model 
the individuals as points and ignore their dimen- 
sions. We consider the equation of motion of in- 
dividual i described by 
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j f(x i -x>),i = l,-'-,N, (1) 



where x 1 G R n represents the position of individ- 
ual i; W = [wy] € R NxN with w tj > for all 
i,j — 1, • • • ,N is the coupling matrix; /(•) rep- 
resents the function of attraction and repulsion 
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between the members. In other words, the direc- 
tion and magnitude of motion of each member is 
determined as a weighted sum of the attraction 
and repulsion of all the other members on this 
member. The attraction/repulsion function that 
we consider is 



f(y) = -y\a- frexp 



(2) 



where a,b, and c are positive constants such that 
b > a and \\y\\ is the Euclidean norm given by 

\\y\\ = \F\Fv- 

In the following discussion we always assume 
via = 0, i = 1, • • • , N in model (1). Moreover, we 
assume that there are no isolated clusters in the 
swarm, that is, W + W T is irreducible. 

Note that the function /(•) is the social po- 
tential function that governs the interindividual 
interactions and is attractive for large distances 
and repulsive for small distances. By equating 
f(y) = 0, one can find that /(•) switches sign 
at the set of points defined as y = {y = or 
\\y\\ — 5 = ycln (fe/a)}. The distance 5 is the dis- 
tance at which the attraction and repulsion bal- 
ance. Such a distance in biological swarms exists 
Note that it is natural as well as reasonable 
to require that any two different swarm members 
could not occupy the same position at the same 
time. 

Remark 1: The anisotropic swarm model 
given here includes the isotropic model of as 
a special case. Obviously, the present model (1) is 
more close to actuality and more meaningful. 



3 Main Results 

In this section, the main results concerning aggre- 
gation and cohesiveness of the swarm (1) are pre- 
sented. In fact, it is interesting to investigate col- 
lective behavior of the system rather than to ascer- 
tain detailed behavior of each individual. And due 
to complex interactions among the multi-agents, 
in general, it is very difficult or even impossible to 
study the specific behavior of each agent. 

Define the center of the swarm members as 
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then we have 
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If the coupling matrix W is symmetric, by the 
symmetry of /(•) with respect to the origin, the 
center x is stationary for all t 4. and the swarm 
described by Eqs. (1) and (2) is not drifting on 
average. Note, however, that the swarm members 
may still have relative motions with respect to the 
center while the center itself stays stationary and 
the members will move toward the swarm center 
and form a cohesive cluster around it. However, if 



the coupling matrix W is nonsymmetric, the cen- 
ter x may not be stationary. An interesting issue 
is whether the members will form a cohesive clus- 
ter and which point they will move around. We 
will deal with this issue in the following theorem. 

Theorem 1: Consider the swarm described 
by the model in (1) with an attraction/replusion 
function /(•) as given in (2). Assume for any 

agent i, we have J2j=i w ij = J2j=i w ji- Then, 
all agents will eventually enter into and remain in 
the bounded region 
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where 
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and A2 denotes the second smallest real eigenvalue 
of the matrix L + L T ; and M 
with 



E L = [kj] 



Uj — 



i = j; 



(4) 



fc=l,fc^i W ik, 

f2 provides a bound on the maximum ultimate 
swarm size. 

Proof. Let e l = x l — x. By the definition of 
the center x of the swarm and the assumption of 
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Wij{x l —x 3 ) exp 
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To estimate e 1 , we let V — E»=i ^» be the Lya- 
punov function for the swarm, where Vi — \e lT e % . 
Evaluating its time derivative along solution of the 
system (1), we have 
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(e 1T ,--- ,e ivT ) T and ftj = exp ( - 
L (g) I is the Kronecker product of L 
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and / with L as denned in Eq. (4) and / the 
identity matrix of order n. 

Note that each of the functions exp ( — 

~ ~c " ) II x% ~ * s a bounded function whose 
maximum occurs at \\X l — x^\\ — y/c/2 and is 
given by */ c/2 exp(— (1/2)). Substituting this 
in the above inequality and using the fact that 
||e l || < y/W, we obtain 

V < -ae T (L®I)e + 2bMy/Zexp(-^)V^. (5) 

To get further estimate of V, we only need to 
estimate the term e T (L ® I)e. Since 

e T {L ® I)e = \e T {{L + L T ) <g> l)e, 

we should analyze e T ((L + L T ) <g) I)e. First con- 
sidering the matrix L + L T and L as defined in 
Eq. (4), we have L + L T = [ly], where 



i 7^3, 
i=3- 



(6) 



Using the conditions 2~2jLi w ij = S^Li^'ii 
we can conclude that A = is an eigenvalue of 
L + L T and u =(/,••• , Z) T with Z ^ is the as- 
sociated eigenvector. Moreover, since L + L T is 
symmetric and W + W T (L + L T ) is irreducible, 
it follows from matrix theory that A = 
is a simple eigenvalue and all the rest eigenval- 
ues of L + L T are real and positive . There- 
fore, we can order the eigenvalues of L + L T as 
= Ai < A2 < A3 < • • • < A n . Also it is known 
that the identity matrix I has an n multiple eigen- 
values fi = 1 and n independent eigenvectors 



By matrix theory jjy, the eigenvalues of (L + 
L T )®I are Ai/i = Ai (n multiple for each i). Next, 
we consider the matrix (L + L T ) ®I. A = is an n 
multiple eigenvalues and the associated eigenvec- 
tors are 
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, u 2 = 
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Therefore , e T ({L + L T ) ®l)e = implies that 
e must lie in the eigenspace of (L+L T )®I spanned 
by eigenvectors v ,v n corresponding to the 
zero engenvalue , that is, e 1 = e 2 = ■ • ■ = e N . This 
occurs only when e 1 = e 2 = • ■ • = e N = 0, but this 
is impossible for the swarm system under consid- 
eration, because it implies that the N individuals 



occupy the same position at the same time. Hence, 
for any solution x of system (1), e must be in the 
subspace spanned by eigenvectors of (L + L T ) ® / 
corresponding to the nonzero eigenvalues. Then, 
e T ((L + L T ) ® I)e > A 2 ||e|| 2 = 2\ 2 V . From (5), 
we have 

V < 



\ 2 V + 26MV^exp(-i)V r ^ 
a\ 2 V 1 / 2 - 26AfVcexp(-i) 



< 
whenever 



V(x) > 



/2&MVccxp(-l/2) 
V a\ 2 



Therefore, any solution of system (1) will eventu- 
ally enter into and remain in fi. □ 

Theorem 1 shows that the swarm members will 
aggregate and form a bounded cluster around the 
swarm center. 

Remark 2: The above discussions explicitly 
show the effect of the coupling matrix W on ag- 
gregation and cohesion of the swarm. 

Remark 3: The conditions given in the above 



theorem 53j=i 
a special case when the coupling matrix W is a 
symmetric matrix. 

Remark 4: Theorem 1 provides a bound on 
the size of the swarm, but the bound is conserva- 
tive. This is because we enlarged V, and we used 
e tT (x l -xi) < H^-a^'lllle*!! 
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include the case as 



the functions exp 



and also assumed that 

■ill 2 " 



.7 



were at 



their maximum value for all i and j. Therefore, 
the actual size of the swarm is, in general, much 
smaller than Q. 

Remark 5: Under the assumption of 
^,f = i Wij — y^f—i w ji: we obtain that the motion 
of the swarm center only depends on the repulsion 
between the swarm members. 



4 Extensions 

In Sections 2 and 3 we consider a specific func- 
tion f(y) as defined in (2). In this section, we will 
consider a more general function f(y) that satisfies 
some assumptions. f(y) is still the social potential 
function that governs the interindividual interac- 
tions and is assumed to have a long rang attraction 
and short range repulsion nature. Following |10j . 
we make the assumptions on the social potential 
function: 

Assumption 1. The attraction/repulsion 
function /(■) is of the form 



f(y) = -y[f a (\\y\\) - fr(\\y\\)},y e R r ' 



(7) 
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where f a : i?+ — > R+ represents (the magnitude 
of) attraction term and has a long range, whereas 
f r : R + — > R + represents (the magnitude of) 
repulsion term and has a short range, and R + 
stands f or th e set of nonnegative real numbers, 
II V II = \/ y T y is the Euclidean norm. 

Assumption 2. There are positive constants 
a, b such that for any y £ R n , 

f a (\\y\\) = a, f r (\\y\\)<JL (8) 

That is, we assume a fixed linear attraction 
function and a bounded repulsion function. 

Theorem 2: Consider the swarm described 
by the model in (1) with an attraction/replusion 
function /(•) as given in (7) satisfied (8). Then, 
all agents will eventually enter into and remain in 
the bounded region 




where p = and A2 and M are defined as in 

Theorem 1; fi* provides a bound on the maximum 
ultimate swarm size. 

Following the proof of Theorem 1, Theorem 2 
can be proved analogously. 

5 Simulations 

In this section we will present some numerical sim- 
ulations for the nonreciprocal swarm described by 
Eqs. (1) and (2) in order to illustrate the theory 
obtained in the previous section. 

In these simulations we used the /(•) func- 
tion which is taken in the form of Eq. (2) with 
a = 1,6 = 20, and c = 0.2. The coupling matrix 
W is generated randomly and satisfies the before 
conditions and assumptions. 

Figs. 1-2 and Figs. 5-6 separately show the 
trajectories of the swarm members and the swarm 
center in which there are N = 10 individuals, and 
the four simulations run for 30s. In order to more 
clearly describe the motion of the swarm members 
and the swarm center, we also present the simu- 
lations of a five-agent swarm, that is, Figs. 3-4, 
and the two simulations run for 100s. It can be 
seen from Figs. 1-6 that at the beginning phase 
of the simulations of the swarm member trajecto- 
ries, all of the members gradually aggregate and 
form a cohesive cluster. Then, they continuously 
move in the same direction as a group, and even- 
tually evolve into an expending spiral motion as 
time increases. 



6 Conclusions 

In this paper, we have considered an anisotropic 
swarm model and analyzed its aggregation. The 
model given here is a generalization of the model 
in [2] and ^Q. And the model is more applicable 
to the reality and is more meaningful. 
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